The Inductive Bias in Concept Learning (extended Abstract)
نویسنده
چکیده
We show that the notion of bias in inductive concept learning can be quantified in a way that directly relates to learning performance, and that this quantitative theory of bias can provide guidance in the design of effective learning algorithms. We apply this idea by measuring some common language biases, including restriction to conjunctive concepts and conjunctive concepts with internal disjunction, and, P uided by these measurements, develop learning algorithms or these classes of concepts that have provably good convergence properties.
منابع مشابه
Quantifying the Inductive Bias in Concept Learning (Extended Abstract)
We show that the notion of bias in inductive concept learning can be quantified in a way that directly relates to learning performance, and that this quantitative theory of bias can provide guidance in the design of effective learning algorithms. We apply this idea by measuring some common language biases, including restriction to conjunctive concepts and conjunctive concepts with internal disj...
متن کاملAdjusting Bias in Concept Learning
We approach concept learning as a heuristic search through a space of concepts for a concept that satisfies the learning task at hand The heuristics represent bias that the concept learning program employs when forming an inductive generalization. We present a model of bias adjustment and report our experience with an implementation of the model. A major objective in research on inductive conce...
متن کاملRapid Prototyping of ILP Systems Using Explicit Bias
We describe a system that allows one to rapidly implement a variety of biases for inductive logic programming; this is an especially suitable area for rapid prototyping, as a number of diierent restrictions on logic programs have been proposed. Our prototyping system is an extension of the Grendel learning system, which accepts two inputs: a set of examples of the concept to be learned, and an ...
متن کاملA Deenition of Learner Uncertainty
The paper considers the quantiication of inductive bias in concept learning. It argues that some of the best known measures of bias (eg. Vapnik-Chervonenkis dimension) are context-free in the sense that they measure the eeectiveness of bias in general, rather than with respect to a particular problem. This approach has many advantages but in cases where we want to evaluate the performance of a ...
متن کاملThe 2005 AAAI Classic Paper Awards
approximately correct learning). At the same time, his paper and his subsequent research applied that theoretical framework to analyze the properties of specific machine learning algorithms. At the time of Haussler’s paper, one informal notion popular in machine learning was the “inductive bias” of a learner; that is, the set of assumptions that, together with the training data, logically entai...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1999